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A METHOD AND APPARATUS FOR DISPLAYING NOTIFICATION 
THAT A COLOR CORRECTED IMAGE IS BEING VIEWED 

5 BACKGROUND OF THE INVENTION 

L Field of the Invention 

This invention relates generally to color imaging technology and more particularly to 
notification devices for indicating when a color correction image is being viewed. The same 
technique has applications for all sensory technology implemented on computers where there 
10 is commercial value in notifying end-users about whether that data has been personalized or 
corrected for their perception. 

2. Description of the Prior An 

Conventional methods for color corrected digital images require the characterization 
of a video system used to create a digital image (source) and the characterization of a video or 

15 printing system that is displaying the color corrected image (client). This is typically done by 
matching the display properties of the source and client, either by mathematical transforms of 
respective color spaces or by forcing the source and client into a matching color state. A 
colorimetric system is essentially a system by which a color can be quantified. A 
colorimetric system can thus be used to characterize the color output of one color imaging 

20 system relative to other color imaging systems. The process of "characterizing" a color 
imaging system generally refers to the calculation of a color response, or input-output 
function for that particular color imaging system using the coordinates of the colorimetric 
system. A colorimetric system also facilitates transformation of color values to produce a 
color output in one color imaging system that matches the color output of a different color 

25 imaging system. The result of matching the display properties of the source and client is that 
the client is able to view the image with similar color characteristics as seen by the source 
author. 

The tremendous popularity of the Internet has brought color imaging technology away 
from technicians in a single facility; and into the hands of low-involvement, mass market, 
30 consumers who are physically removed from the Web authoring process. This changes the 
requirements for imaging systems where previously there was no communication between 
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content author or viewer, and no need for it. This method and apparatus address the new 
problem for both consumers and web merchants caused when consumers are unable to know 
anything about the color correction status of an image. For example, web-based shopping 
catalogs compete with printed catalogs for the same sales dollars. However, for web catalogs 
to compete effectively with their printed counterparts, they must provide consumers with the 
same level of benefits now enjoyed with catalogs in print. One is these benefits is color- 
corrected imagery consumes can trust. Thus, as color corrected images displayed over the 
Internet become more widely available to the general public, a method is needed to inform 
clients that their display system either is, or is not, currently displaying color-corrected 
images. 

In an attempt to identify color corrected images, conventional images are color tagged 
with information, often in an International Color Consortium ("ICC") color profile format, 
before posting on a compact disc, web site, or other repository for later viewing, as is well 
known in the industry and defined by the ICC Profile Format Specification, Version 3.4 — 
August 15, 1977, the contents of which are hereby incorporated by reference (latest version 
available at http://www.color.org) . These images may even have some special watermark or 
logo indicating that they are authored in a manner enabling color accurate display, such as 
"authored with ColorSync®," or some similar logo.. 

Moreover, conventionally, Internet browsers, servers, and/or other image viewing 
software, such as Internet Explorer (version 4.01 and later) and Silicon Graphics ("SGI") 
Cosmo Color, can look for an ICC format color profile on the client or target display for use 
in color correcting the image seen. These browsers or viewers might have some logo or mark 
or technical description indicating that they offer "color accurate browser technology," 
indicating that they are enabled to display color-corrected images, under certain conditions. 

Conventional approaches are generally deficient, however, in that end-users cannot 
rely on the above noted marks to know if in fact they are presently viewing an image in a 
color accurate state. For example, it may be such that the image was enabled for color 
correction but the browser and server technology do not enable the client to properly display 
the image. Conversely, the browser and/or server may be enabled to color correction for the 
client, but the image currently being viewed is not authored with use of ICC format profiles, 
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or in some other way as to enable display with color accuracy. Thus, only when both the 
image authoring and image viewing technologies enable color correction is the image seen 
with color accuracy. Since conventional approaches fail to sufficiently inform an end-user 
client that a color correction process has actually occurred on a particular image, the end-user 
5 does not know whether a color accurate image is currently being viewed. 

What is needed therefore is an apparatus and method for providing to an end user 
client feedback as to the color correction status of imagery shown on the client display. 
Although the current application of this apparatus and method relates to color-corrected 
imagery, a similar apparatus and method would be used related to any type of resolution or 
10 image correction, to correction of sound or auditory characteristics, to correction of feel 

characteristics as with the use of a joystick or other input device, or to any other human input 
(taste, smell), or any other correction of analog or sensory data. 

SUMMARY OF THE INVENTION 

The present invention provides, in a first aspect, a method for providing feedback to 
15 either a remote (i.e., physically at a different location, or connected via a client/server 

architecture or method), or a local (i.e., within a single location or computer) user as to color 
correction status of an image displayed on a system, including the steps of determining the 
presence of color correction information in the image, determining the state of calibration of 
the user's system, and notifying the user of color correction status in accordance with the 
20 steps of determining the presence of color correction information in the image and 
determining the state of calibration of the user's system. 

In another aspect, the present invention provides a client based icon applet for use in 
indicating to an end user a state of color correction of digital images being viewed, including 
an icon having a first state indicating that images being viewed are color corrected as viewed 
25 and a second state indicating that images being viewed are not color corrected as viewed, and 
logic for determining if the image being viewed includes a color notification tag and a display 
device associated with the use is calibrated for corrected color display for inserting a selected 
state of the icon to be inserted in the digital image to be viewed. 
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These and other features and advantages of this invention will become further 
apparent from the detailed description and accompanying figures that follow. In the figures 
and description, numerals indicate the various features of the invention, like numerals 
referring to like features throughout both the drawing figures and the written description. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a flow chart illustrating the method for providing end user (client) feedback 
as to the color correction status of imagery shown on the client display in accordance with the 
preferred embodiment of the invention. 

FIG. 2 is a depiction of a screen view of a web page that is enabled to be color- 
10 corrected using an HTML tag in accordance with the method shown in FIG. 1 . 

FIG. 3 is a functional block diagram of a client-based notification system for 
providing critical end user feedback as to the color correction status of imagery on a client 
display. 

FIG. 4 is a functional block diagram of a server-based notification system for 
1 5 providing critical end user feedback as to the color correction status of imagery on a client 
display. 

FIG. 5(a) is a picture of a typical icon for notifying the user that the image has been 
color corrected on a client display in accordance with the present invention. 

FIG. 5(b) is a picture of a typical icon for notifying the user that the image has not 
20 been color corrected on a client display in accordance with the present invention. 



PET ATT ED DESCRIPTION OF THE PR EFERRED EMBODIMENT(S) 

The present invention provides a system and method for providing end user (client) 
feedback as to the color correction status of imagery on a client display, thus notifying the 
25 user that the color image being viewed is color accurate. This information is critical since i 
end user is often in a remote location, separated in time and distance from the author of the 
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image, and unable to know the characteristics of the imaged being viewed. In particular, the 
present invention automatically informs viewers and/or other receivers of digital images as to 
the state of color correction for the digital images, thus notifying a viewer of the visual 
integrity of the digital image being displayed. Consequently, viewers feel assured and secure 
5 about images they see as to the color accuracy of those images. 

In particular, the present invention is implemented as a software process that is loaded 
into either an Internet browser or server technology. A browser is a client application that 
enables a user to view HTML (or equivalent) documents on the web, another network, or the 
user's computer. The software may be implemented in the form of a small program, such as 

10 Java or ActiveX application programs, that is loaded into a web browser, such as Microsoft's 
Internet Explorer or Netscape's Navigator. The software may also be implemented on server 
technology, such as Cosmo Color from Silicon Graphics. One skilled in the art will recognize 
that other conventional or newly developed software processes may be used as well and the 
invention may be implemented using hardware or a combination of hardware and software. 

15 One skilled in the art will recognize that the invention can apply to other browser technology, 
such as local CD browsers and other non-Intemet browsers. 

Referring to FIG. 1, a flowchart 10 of an algorithm for implementing the present 
invention is illustrated. The present invention is typically enabled when browser begins to 
reassemble the web page onscreen, following the hidden HTML codes in the main document 
20 to determine where to place text, graphics or videos onscreen. In particular, the present 

algorithm is implemented when browser begins to assemble the image part of the web page to 
be displayed. One skilled in the art, however, will recognize that implementation of the 
present invention can be initiated at anytime an image is present. The present invention 
initially determines whether the image has been color enabled (step 12) and whether the 

25 image has been color corrected (step 14). The present invention then determines the whether 
the system is acting in accordance with steps 12 and 14 above to provide color accuracy (step 
16). Upon determining whether the image is color enabled (step 12) and corrected (step 14), 
notification is provided about the integrity of color imagery currently being viewed by the 
client at a specific web site. In particular, when the image is color enabled and corrected, 

30 notification is provided to the client that the color of the image is accurate (step 1 8). If the 
image is not either color enabled or corrected, notification is provided to the client that the 
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color of the image may not be accurate (step 20). The invention then returns to a standby 
mode until another web page with images is detected. 

As noted above, in step 12, the present invention determines whether the displayed 
imaoe has been color enabled by detecting whether there is color correction information 0 .e. 
colour specific files for the device characteristics of the reference image as represented on the 
reference device) associated with the displayed image. For example, to detect whether an 
ima.e is color enabled, the present invention detects whether the following color corrects 
infoLuon (i.e. color specific files or registry entries) is associated with the image: (1) user 
specific Hypertext Markup Language (HTML) tags within the web page that debate the 
color properties of the source image, (2) standard ICC profiles which are embedded wtthm the 
imaoe file itself and (3) pointers to user specific (i.e. HTML) or standard (i.e. ICC profiles) 
colour files associated with the image file. One skilled in the art will recognize that the present 
invention is not limited to detecting specific color correction information, nor is U hmrted just 
to fully composed web pages as opposed to individual images or portions of images. 

In operation, to determine whether an image is color enabled via HTML color 
corrected information, the preferred embodiment of the present invention detects whether user 
selected predetermined HTML tags are present in the web page. HTML, a markup language 
used for documents on the web, uses standard tags to mark elements, such as text and 
graphics, in a document to indicate how web browsers should display these elements to the 
user and should respond to user actions. The present embodiment detects whether the web 
page includes predetermined HTML tags. For example, in the preferred embodiment, when a 
web page with an image is color enabled, the HTML tags direct a browser to dtsplay a 
predetermined text as a headline of a certain size, such as the title "True Internet Color": 

<html> Marks the beginning and end of an HTML-coded file 
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</head> Contains descriptive information, like the .title and author, not delayed 

onscreen. It also holds formatting information, such as style sheets 
<title> Shop-o-rama True Internet Color(r)</title> Sets the web page s title, 

displayed in the blue bar atop the screen , 
Contains descriptive information, like the title and author, not displayed 
onscreen. It also holds formatting information, such as style sheets. 



</head> 



onscreen, u aisu uuiua luuuaiung , — 

<html> Marks the beginning and end of an HTML-coded file 

FIG. 2 is a depiction of a screen view of a web page 22 having a title "True Internet 
Color" thus enabling the present invention to recognize that the page is color enabled. Thus 
when a web page includes the title "True Internet Color" the image is considered to be color 
enabled. One skilled in the art will recognize that the present invention is not limited to 
recognition of HTML tags directed at the title "True Internet Color," but rather may be any 
predetermined HTML tag, or web image tag, configuration. 

To determine whether an image is color enabled via ICC color correction information, 
the present invention detects whether ICC profiles (for the device characteristics of the 
reference image as represented on the reference device) are embedded within the image file 
based upon an ICC profile format specification. In particular, the present invention detects 
data stored in ICC profiles, which are described in the ICC profile specification. ICC profiles 
are device profiles that can be used in pairs to translate color data created on one device into a 
native color space of another device. More specifically, an ICC profile is provided for each 
device and is used by the present invention to transform color image data from a device- 
dependent color space to the profile connection space, and to transform color image data from 
the profile connection space to another device-dependent color space. These ICC profiles for 
the device characteristics of the reference image as represented on the reference device may 
be embedded in the image file or stored in a memory in a connected personal computer. For 
example the ICC profiles could be stored in a memory, accessible by a CPU, and associated 
with the image instead of embedded. Additionally, it should be noted that ICC profile can be 
assessed by the client from a variety of other sources such as network interface or from other 
) external devices via a modem interface. 

To determine whether an image is color enabled-even without an embedded or 
associated color profile-the present invention detects whether the image is in a known color 
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15 



space such as SRGB. SRGB is a well-defined color space, includes various versions such as 
SRGB 64, and is further defined at http://www.srgb.com. One skilled in the art will recognize 
that implementation of the present invention may be used with any kinds of images, including 
those subject to compression techniques, such as GIF, PNG or JPEG formatted images. 

Referring to step 14, the present invention interrogates the client system to determine 
if that system is characterized and cal.brated to the same state, or to a different but known 
state in other words, the present invention detects the presence of a transfer function m the 
client system, i.e. in the hardware or software (or the combination of hardware/software and 
human perception). In particular, the present invention checks file entries and registries, or 
, pointers to such entries and registries, to determine whether characterization parameters are 
present. A flag, initialized to a set value, signals whether the client system has been 
characterized. For example, in a typical embodiment, a binary flag initialized to a zero value 
is set to a non-zero value when the present invention detects the client system is characterized. 
In accordance with the present invention, a client may use any type of conventional or newly 
developed color calibration system including, for example, the interactive color calibration 
method disclosed in U.S. Patent No. 5,638,1 17. 

Referring to step 16, the present invention then determines the whether the system is 
acting in accordance with steps 12 and 14 above to provide color accuracy. In particular, 
once the present invention confirms that the presence of color correction information in the 
displayed image (step 12) and the image has been adjusted, as needed, to display properly on 
the calibrated or characterized client system (step 14) (i.e. color accuracy is being provided 
for in step 16), a notification is displayed to the user (step 18). When the software process 
determines that color accurate display is occurring on all or part of the image, then an 
appropriate notification is made to inform the user that color correction has occurred where 
25 marked. One skilled in the art will recognize that the particular type of notification is not 

critical to the invention. The notification may be visual or non-visual notification (e.g. audio). 
For example, the visual notification may be an icon that provides users with a visible 
indication about the integrity of color imagery currently being viewed by the client at a 
specific web site. It does this by briefly flashing the cursor for a fraction of a second to 
30 indicate if whether or not the page is being viewed utilizing color correction. This icon can be 
implemented in addition, or instead, in the OS, in a web-enabled application, or in a browser 
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(when implemented on as a client-side application); or it can be implemented as an image, 
tag, program, or watermark embedded within a web page by the web server or by any of the 
links between server and client within the network infrastructure. 

For example, when a user requests a Web page from a web site enabled by the present 
5 invention, the HTML is sent to the client directly from the web site's main servers. A 

specially attached URL link calls up color-corrected images from the hosted server, and the 
client's browsers integrate the two pieces automatically. Thus, in accordance with the present 
invention, the notification not only provides notification feedback to the user, but also 
reinforces a message of data fidelity to the end-user in determining whether the color data is 
10 accurate or not. The present invention has applicability for any client viewing or display 
application where color accuracy is important to the communication of information. 
Examples include, but are not limited to, viewing artwork, fashion, cosmetic, logo or brand 
colors, paint, photography and other color-sensitive information over a medium such as the 
Internet where content viewer and content creator are disconnected by physical space and/or 
15 time. Although, for illustrative purposes, the present invention is described and illustrated 
utilizing web pages hosted on a server and displayed with color correction on a client, the 
invention is not limited to such a configuration. Rather, the present invention would apply 
equally well to images displayed on any imaging peripheral including transmissive, reflective, 
and other source and/or client imaging technologies. Moreover, the present invention would 
20 also apply to images not viewed by the Internet, such as images within computer applications. 
TV, broadcast, or other client output media of any kind, including printed output. The present 
method would apply to both digital images and analog images including both real and 
synthetic images authored for, and/or viewed on, a client system. 

The present invention may be implemented as a client-based notification system 30 as 
25 shown in FIG. 3 or server-based notification system 50 as shown in FIG. 4. With respect to a 
client-based notification system, the present invention may be installed on a client system 
such as client 38, peripheral, and/or other output technology that has various states of visual 
display to notify the user about the state of color correction for digital images output or 
displayed. Referring to FIG. 3, a functional block diagram of a client-based notification 
30 system 30 for providing critical end user feedback as to the color correction status of imagery 
on a client display is illustrated. Client-based notification system 30 is shown with hosted 
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co,or server 32, mirrored server 34, „o„-m,rrored server* and Cents 38, 40, 42, 4 and 46 
which represent the various types of Cents, that is, clients such as 38 and 40 whtch tnclude 
,he chent based notification techniques of the present invention (indicated by the .em, 
"icon"), cheats 38, 40, 42 and 44 whtch are characterized for co.or, c.ients 42 and 44 whtch 
5 have a known transfer function and chen, 46 which is no, characterized, has no Known co.or 
transfer function and does no. inc.ude a notification system according to the present 
invention. 

,con 66 depicted in Kg. 5(b), provided by client 38 is preferably initiared to a non- 
corrected state. When client 38 sends a request to mitrored server 34, whtch — 
10 co,or server 32, a co.or corrected requested image is sent front hosted color — 
38 tncluding a co.or notification tag. such as a specific HTML fide bar fiag. The Web „ 
HTML from server 34 inc.udes a co.or notification tag wirhin its HTML rags to mdtcate tn 
„,,e bar that the images to be sen. by server 32 have been enab.ed for co.or correc.,0. For 
example, as shown in FIG. 2, .he tide bar of the web page may inc.ude a notification m «s 
,5 tifie bar, such as "True Interne, Co.or", in addition to other terms such as the name of a 
re ,a.ed company, to indicate co.or correction. As noted above, one sKi.led in me an wri^ 
recognize that .he present invention is no. .united to the detection of prede«ermmed HTML 
litl e tags, rathe, any device capab.e of detection may be used as .he co.or notification tag. 
Upon arrival a. .he chen. 38, .he presen. invention detects me co.or no.ifica.ion tag by 
20 daring me HTML rags sen. from server 34 to determine whether the image dehvered rom 
server 32 has been co.or correction enab.ed by detecting the True Interne. Color tag n the 
tit ,e .. a.so checks whether client 38 has been co,or characterized or cahbrated to aknown 
srate ,f bom conditions a* ttue, an icon such as icon 66 depicted in FIG. 5(b) is changed to a 
coveted state as depicted by icon 64 in FIG. 5(a). In contrast, when dien. 38 send, a 
25 request ,o a site providing non co.or corrected pages, such as non-mirrored server 

does no. include the specia, HTML tags, such as 'True Interne. Color" ,o indicate co.or 
correction, .hen icon 66 remains unchanged from its non-correc.ed defaul. state. 

Still referring to FIG. 3, local chen, 40 is characterized but includes no applet 
incorporating the presen, invention for notification as indicated by the phrase "no-icon". 
30 Loca, chen, 40 is in direc, communication with rnirrored server 34 and hosted color server 32. 
Loca.clien,40providesnonotifica,ionicon. When loca. client 40 sends a request to 
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mirrored server 34, the requested image is color corrected and sent back by hosted color 
server 32 with no notification icon on client 40. When local client 40 communicates with 
non-mirrored server 36, the requested image is not color corrected, and there is no notification 
icon to this effect. 

Client 42 is characterized and includes a known (characterized or calibrated) transfer 
function but no applet incorporating the present invention for notification. Client 42 is in 
direct communication with mirrored server 34 and non-mirrored server 36 and in direct 
communication with hosted color server 32 via redirection requests from mirrored server 34. 
Ghent 42 provides no notification icon. When client 42 sends a request to mirrored server 34, 
the requested image is corrected. However, no notification indicating color correction is sent 
back to client 42. When client 42 sends a request to non-mirrored server 36, the requested 
image is not color corrected and no notification of color correction is sent back to client 42. In 
such case, the title bar of the web page would not indicate a color corrected image. 

Client 44 is characterized and includes a known (characterized or calibrated) transfer 
> function and includes an applet incorporating the present invention for notification. Client 44 
is in direct communication with mirrored server 34 and non-mirrored server 36 and in direct 
communication with hosted color server 32 via redirection requests from mirrored server 34. 
Client 44 provides a notification icon. When client 44 sends a request to mirrored server 34, 
the requested image sent by hosted color server 32 is color corrected. In such case, the title 
0 bar of the web page would indicate a color corrected image. Notification indicating color 
correction is sent back to client 44 indicating a color corrected image being displayed. When 
client 44 sends a request to non-mirrored server 36, the requested image is not corrected and 
no notification of color correction is sent back to client 44. In such case, the title bar of the 
web page would not indicate a color corrected image. 
25 Client 46 is neither characterized nor includes an application incorporating the present 

invention for notification. Client interacts with non-mirrored server 36 only and provides no 
notification icon. When client 46 sends a request to non-mirrored server 36, which is not in 
mirror communication with hosted color server 32, the requested image sent by non-mirrored 
server 36 is not color corrected and no notification is provided to the client 46. In such case, 
30 the title bar of the web page would not indicate a color corrected image. 
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Refemng now to FIG. 4, a functional block diagram of a server-based nonf.cat.on 
system 50 for providing critical end user feedback as to the color correction status of tmagery 
on a client display is illustrated. With aspect to a server-based notification system, the 
present invention may be installed on a web s„e server to notify the user about the state of 

5 color correction for digital images output or displayed. In pabular, the icon of .he present 
invention can be .mp.emen.ed in an image, rag, program, or wa.em.ark embedded wt.hm a 
web page by .he web server or any of .he links be.ween server and die,. wi.hin the network 
infrastructure. Server-based notification system 50 is shown wtth hosted color server 52, 
mi rrored server 54, non-mirroted server 56 and clients 58, 60, 62 and 64. The icon of the 

,0 presen, invention is installed in hosted color server 52 and mirrored server 54 and no, ,n non- 
mirrored server 56. 

When client 58 sends a request to hosted 52, client 58 may communicate through 
some means that it is a client that is of a specific, known calibration. This notification may be 
included in the HTML stream sent by the browser, or via any other method. In mat case, tf a 

15 color corrected image is sent tern hosted color server 52 (or from mirrored server 54) to 
client 58, men an icon is also sent by mirrored server 54 or by hosted color server 52 ,o 
indicate tha. .he image has been corrected. In contrast, when client 58 sends a truest to non- 
ntoored server 56, which is nor in communication with hosted color server 52, non-rumored 
server 56 does no. include an icon (or sends an icon indicating tha, no color correctton has 

20 occurred). 

in accordance with an alternative embodiment of the invention, client 60 is 
characterized and includes an applet incorporating .he presen. invention for proving 
notification. Local client 60 is in direct communication with mirrored server 54 or hosted 
color server 52, which also includes me notification icon. When clien. 60 sends a mques. to 
25 mirmred server 54 or hos,ed color server 52 as described above, .he requested image is color 
corrected and sen, back by web sire server along with a notification icon ind,ca,mg a 
eoneeted stare. Mirrored server 54 also sends the HTML tags indicating color correction and 
the icon on client is changed ,o indicate the corrected state. Logic is implemented <o arbtrrate 
berween the state of the two icons (server-baaed and clien.-based). For example, m one 
30 embodimen. eirher the server or clien, based notification icon may take precedence whtle ,n 
another embodimen, a third icon, similar to the icons shown in FIGS. 5(a) and (b), may be 
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used to indicate the presence of a different level of color correction based on the presence of 
both server and client based notifications. 

Client 62 is neither characterized nor includes an application incorporating the present 
invention for notification. When client 62 sends a request to server 54, then either server 52 

5 would use HTML tags to add some watermark or other image to the web page to indicate 
color accuracy; or server 52 would request web server 54 to send an image which already has 
an icon superimposed on the image sent by server 54. When client 62 sends a request to non- 
mirrored server 56, the requested image sent by non-moored server 56 is not color corrected 
and no notification is provided to client 62. In such case, the title bar of the web page would 

10 not indicate a color corrected image, and no icon would be sent by non-mirrored server 56. 

In accordance with an alternative embodiment of the present invention, depending 
upon the relationship between the mirrored server 54 and hosted color server 52, hosted color 
server 52 may require mirrored server 54 to identify images not color corrected. In such case, 
a server based icon can be sent to a client to indicate images which are not color corrected. 

15 In accordance with another alternative embodiment of the present invention, 

multilevel icon certifications may be provided. In particular, multilevel icon certifications can 
be utilized to distinguish between icon certifications between various entities providing for 
color correction. For example, when hosted color server 52 provides color correction, an icon 
identifying not only color correction, but correction specifically provided by a particular 
20 hosted color server, is sent to the client. On the other hand, if color correction is provided by 
another entity, an icon identifying color correction, without identification of a specific entity 
providing for correction, is sent to the client. 

Having now described the invention in accordance with the requirements of the patent 
statutes, those skilled in the art will understand how to make changes and modifications in the 
25 present invention to meet their specific requirements or conditions. Such changes and 

modifications may be made without departing from the scope and spirit of the invention as set 
forth in the following changes. 
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WHATTS CLAIMED IS: 

1 . A method for providing feedback to a user as to color correction status of an image 
on a local display, comprising the steps of: 

determining presence of color correction information in said image; 
5 determining state of calibration of said user's system; 

notifying said user of color correction status in accordance with said steps of 
determining the presence of color correction information in said image and determining state 
of calibration of said user's system. 

10 2. The method claimed in claim 1 , wherein said method is implemented in a software 
process loaded into an Internet browser. 

3. The method claimed in claim 1, wherein said method is implemented in a software 
process loaded into a content browsing application.. 

4. The method claim in claim 1 , wherein said method is implemented in a software 
1 5 process loaded into server technology that is viewed by a remote client. 

5. The method claimed in claim 1 , wherein said method is implemented in a software 
process loaded into server technology that is viewed by a local client. 

6. The method in claim 1 , wherein said method is implemented both as a software 
process loaded into a content browsing application and server technology approximately 

20 simultaneously, together with an arbitration mechanism to determine the proper notification 
of status. 

7. The method claimed in claim 1 , wherein said color correction information comprises 
HTML color information. 

25 8. The method claimed in claim 1 , wherein said information on the state of calibration of 
said end users' system comprises HTML color information. 
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9. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting whether HTML tags that designate color properties are present in a web page 
associated with said image. 

10. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of detecting whether HTML 
tags that designate color properties are sent via one server, referencing said image sent by a 
different server. 

1 1 . The method in claimed in claim 1 , wherein the information about the state of 
^calibration of said user's system is determined by said server by detecting HTML tags sent by 

said server. 

12. The method claimed in claim 1 , wherein said color correction information comprises 
ICC profile color correction information. 

13. The method claimed in claim 1 , wherein the information about the state of calibration 
of said user's system comprises ICC-format profile information. 

14. The method claimed in claim 1 , wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting whether ICC profiles are embedded within the image, or associated with the 
file, based upon ICC profile format specifications. 

15. The method claimed in claim 1 , wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting GIF-formatted images based upon GIF profile format specifications. 

16. The method claimed in claim 1 . wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting PNG-formatted images based upon PNG profile format specifications. 
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17. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting JPEG-formatted images based upon JPG profile format specifications. 

18. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting images in a known color space. 

19. The method claimed in claim 1 , wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting images in a predefined color space. 

20. The method claimed in claim 1, wherein said step of notifying said user of color 
correction status in accordance with said steps of determining the presence of color correction 
information in said image and determining state of calibration of said user's system, further 
comprises the step of: 

providing a visual notification regarding the status of color correction status of said 

image. 

21. The method claimed in claim 20, wherein said visual notification is an icon. 

22. The method claimed in claim 1, wherein said step of notifying said user of color 
correction status in accordance with said steps of determining the presence of color correction 
information in said image and determining state of calibration of said user's system, further 
comprises the step of: 

providing auditory notification regarding the status of color correction status of said 

image. 

23. The method claimed in claim 1, wherein said step of notifying said user of color 
correction status in accordance with said steps of determining the presence of color correction 
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information in said image and determining state of calibration of said user's system, further 
comprises the step of: 

providing sensory notification regarding color correction status of said image. 

5 24. The method claim claimed in claim 23, wherein said step of providing sensory 

notification regarding the status of color correction status of said image, further comprises the 
step of: 

providing touch-based notification regarding color correction status of said image. 

10 25. The method claim claimed in claim 23, wherein said step of providing sensory 

notification regarding the status of color correction status of said image, further comprises the 
step of: 

providing taste-based notification regarding color correction status of said image. 

15 26. The method claim claimed in claim 23, wherein said step of providing sensory 

notification regarding the status of color correction status of said image, further comprises the 
step of: 

providing smell-based notification regarding color correction status of said image. 

20 27. A client based icon applet for use in indicating to an end user a state of color 
correction of digital images being viewed, comprising: 

an icon having a first state indicating that images being viewed are color corrected as 
viewed and a second state indicating that images being viewed are not color corrected as 
viewed; and 

25 logic for determining if the image being viewed includes a color notification tag and a 

display device associated with the use is calibrated for corrected color display for inserting a 
selected state of the icon to be inserted in the digital image to be viewed. 

28. The client based icon applet claimed in claim 27, wherein said icon is initiated to the 
30 second state indicating that images being viewed are not color corrected as being viewed as a 
default state. 
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29. The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for evaluating HTML tags sent by a server to determine whether said image has 
been color corrected. 

30. The client based icon applet claimed in claim 29, wherein said logic for evaluating 
HTML tags sent by a server to determine whether said image has been color corrected further 
comprises: 

logic for evaluating predetermined HTML title tags sent by a server to determine 
whether said image has been color corrected. 

3 1 . The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for detecting the presence of a transfer function in a client system. 

32. The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for detecting the presence of characterization parameters. 

33. The client based icon applet claimed in claim 27, further comprising: 

a flag having a first state indicating that the display devices associated with the use is 
calibrated for corrected color display and a second state indicating that the display devices 
associated with the use is not calibrated for corrected color display; and 

logic for determining if the display device associated with the use is calibrated for 
corrected color display for determining a selected state of the flag. 
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34. The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

5 logic for inserting the icon having the first state indicating that images being viewed 

are color corrected and the display device associated with the use is calibrated for corrected 
color display. 

35. The client based icon applet claimed in claim 27, wherein said logic for determining if 
10 the image being viewed includes a color notification tag and a display device associated with 

the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for inserting the icon having the second state indicating that images being 
viewed are not color corrected or the display device associated with the use is not calibrated 
15 for corrected color display. 

36. The client based icon applet claimed in claim 28, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 

20 inserted in the digital image to be viewed further comprises: 

logic for leaving the icon in the default second state indicating that images being 
viewed are not color corrected or the display device associated with the use is not calibrated 
for corrected color display. 

25 37. The client based icon applet claimed in claim 27, wherein said icon also identifies 
color correction by a particular server. 

38. A server based icon applet for use in indicating to an end user a state of color 
correction of digital images being viewed, comprising: 
30 an icon having a first state indicating that images being viewed are color corrected as 

viewed and a second state indicating that images being viewed are not color corrected as 
viewed; and 
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logic for determining if a client has a specific, known calibration for inserting a 
selected state of the icon to be inserted in the digital image to be viewed. 

39. The server based icon applet claimed in claim 38, wherein said logic for determining if 
5 a client has a specific, known calibration for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for determining the presence of an HTML stream sent by a browser associated 
with said client. 

10 40. The server based icon applet claimed in claim 39, wherein said logic for determining 
the presence of an HTML stream sent by a browser associated with said client further 
comprises: 

logic for inserting the icon having the first state indicating that images being viewed 
are color corrected when a HTML stream is detected. 

15 

41 . The server based icon applet claimed in claim 39, wherein said logic for determining 
the presence of an HTML stream sent by a browser associated with said client further 
comprises: 

logic for inserting the icon having the second state indicating that images being 
20 viewed are not color corrected when a HTML stream is not detected. 
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A METHOD AND APPARATUS FOR DISPLAYING NOTIFICATION 
THAT A COLOR CORRECTED IMAGE IS BEING VIEWED 

5 BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates generally to color imaging technology and more particularly to 
notification devices for indicating when a color correction image is being viewed. The same 
technique has applications for all sensory technology implemented on computers where there 
10 is commercial value in notifying end-users about whether that data has been personalized or 
corrected for their perception. 

2. Description of the Prior Art 

Conventional methods for color corrected digital images require the characterization 
of a video system used to create a digital image (source) and the characterization of a video or 

1 5 printing system that is displaying the color corrected image (client). This is typically done by 
matching the display properties of the source and client, either by mathematical transforms of 
respective color spaces or by forcing the source and client into a matching color state. A 
colorimetric system is essentially a system by which a color can be quantified. A 
colorimetric system can thus be used to characterize the color output of one color imaging 

20 system relative to other color imaging systems. The process of "characterizing" a color 
imaging system generally refers to the calculation of a color response, or input-output 
function for that particular color imaging system using the coordinates of the colorimetric 
system. A colorimetric system also facilitates transformation of color values to produce a 
color output in one color imaging system that matches the color output of a different color 

25 imaging system. The result of matching the display properties of the source and client is that 
the client is able to view the image with similar color characteristics as seen by the source 
author. 

The tremendous popularity of the Internet has brought color imaging technology away 
from technicians in a single facility; and into the hands of low-involvement, mass market, 
30 consumers who are physically removed from the Web authoring process. This changes the 
requirements for imaging systems where previously there was no communication between 
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content author or viewer, and no need for it. This method and apparatus address the new 
problem for both consumers and web merchants caused when consumers are unable to know 
anything about the color correction status of an image. For example, web-based shopping 
catalogs compete with printed catalogs for the same sales dollars. However, for web catalogs 
to compete effectively with their printed counterparts, they must provide consumers with the 
same level of benefits now enjoyed with catalogs in print. One is these benefits is color- 
corrected imagery consumes can trust. Thus, as color corrected images displayed over the 
Internet become more widely available to the general public, a method is needed to inform 
clients that their display system either is, or is not, currently displaying color-corrected 
images. 

In an attempt to identify color corrected images, conventional images are color tagged 
with information, often in an International Color Consortium ("ICC") color profile format, 
before posting on a compact disc, web site, or other repository for later viewing, as is well 
known in the industry and defined by the ICC Profile Format Specification, Version 3.4— 
August 15, 1977, the contents of which are hereby incorporated by reference (latest version 
available at htt p://www.color.org) . These images may even have some special watermark or 
logo indicating that they are authored in a manner enabling color accurate display, such as 
"authored with ColorSync®," or some similar logo.. 

Moreover, conventionally, Internet browsers, servers, and/or other image viewing 
software, such as Internet Explorer (version 4.01 and later) and Silicon Graphics ("SGI") 
Cosmo Color, can look for an ICC format color profile on the client or target display for use 
in color correcting the image seen. These browsers or viewers might have some logo or mark 
or technical description indicating that they offer "color accurate browser technology," 
indicating that they are enabled to display color-corrected images, under certain conditions. 

Conventional approaches are generally deficient, however, in that end-users cannot 
rely on the above noted marks to know if in fact they are presently viewing an image in a 
color accurate state. For example, it may be such that the image was enabled for color 
correction but the browser and server technology do not enable the client to properly display 
the image. Conversely, the browser and/or server may be enabled to color correction for the 
client, but the image currently being viewed is not authored with use of ICC format profiles, 
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or in some other way as to enable display with color accuracy. Thus, only when both the 
image authoring and image viewing technologies enable color correction is the image seen 
with color accuracy. Since conventional approaches fail to sufficiently inform an end-user 
client that a color correction process has actually occurred on a particular image, the end-user 
5 does not know whether a color accurate image is currently being viewed. 

What is needed therefore is an apparatus and method for providing to an end user 
client feedback as to the color correction status of imagery shown on the client display. 
Although the current application of this apparatus and method relates to color-corrected 
imagery, a similar apparatus and method would be used related to any type of resolution or 
10 image correction, to correction of sound or auditory characteristics, to correction of feel 

characteristics as with the use of a joystick or other input device, or to any other human input 
(taste, smell), or any other correction of analog or sensory data. 

SUMMARY OF THE INVENTION 

The present invention provides, in a first aspect, a method for providing feedback to 
15 either a remote (i.e., physically at a different location, or connected via a client/server 

architecture or method), or a local (i.e., within a single location or computer) user as to color 
correction status of an image displayed on a system, including the steps of determining the 
presence of color correction information in the image, determining the state of calibration of 
the user's system, and notifying the user of color correction status in accordance with the 
20 steps of determining the presence of color correction information in the image and 
determining the state of calibration of the user's system. 

In another aspect, the present invention provides a client based icon applet for use in 
indicating to an end user a state of color correction of digital images being viewed, including 
an icon having a first state indicating that images being viewed are color corrected as viewed 
25 and a second state indicating that images being viewed are not color corrected as viewed, and 
logic for determining if the image being viewed includes a color notification tag and a display 
device associated with the use is calibrated for corrected color display for inserting a selected 
state of the icon to be inserted in the digital image to be viewed. 
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These and other features and advantages of this invention will become further 
'apparent from the detailed description and accompanying figures that follow. In the figures 
and description, numerals indicate the various features of the invention, like numerals 
referring to like features throughout both the drawing figures and the written description. 

5 BRIEF DESCRIPTION OF TH E DRAWINGS 

FIG. 1 is a flow chart illustrating the method for providing end user (client) feedback 
as to the color correction status of imagery shown on the client display in accordance with the 
preferred embodiment of the invention. 

FIG. 2 is a depiction of a screen view of a web page that is enabled to be color- 
10 corrected using an HTML tag in accordance with the method shown in FIG. 1 . 

FIG. 3 is a functional block diagram of a client-based notification system for 
providing critical end user feedback as to the color correction status of imagery on a client 
display. 

FIG. 4 is a functional block diagram of a server-based notification system for 
1 5 providing critical end user feedback as to the color correction status of imagery on a client 
display. 

FIG. 5(a) is a picture of a typical icon for notifying the user that the image has been 
color corrected on a client display in accordance with the present invention. 

FIG. 5(b) is a picture of a typical icon for notifying the user that the image has not 
20 been color corrected on a client display in accordance with the present invention. 



TYRTATT .F.D DESCRIPTION OF THE PREFERRED EM BODIMENT(S) 

The present invention provides a system and method for providing end user (client) 
feedback as to the color correction status of imagery on a client display, thus notifying the 
25 user that the color image being viewed is color accurate. This information is critical since the 
end user is often in a remote location, separated in time and distance from the author of the 
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image, and unable to know the characteristics of the imaged being viewed. In particular, the 
present invention automatically informs viewers and/or other receivers of digital images as to 
the state of color correction for the digital images, thus notifying a viewer of the visual 
integrity of the digital image being displayed. Consequently, viewers feel assured and secure 
5 about images they see as to the color accuracy of those images. 

In particular, the present invention is implemented as a software process that is loaded 
into either an Internet browser or server technology. A browser is a client application that 
enables a user to view HTML (or equivalent) documents on the web, another network, or the 
user's computer. The software may be implemented in the form of a small program, such as 

10 Java or ActiveX application programs, that is loaded into a web browser, such as Microsoft's 
Internet Explorer or Netscape's Navigator. The software may also be implemented on server 
technology, such as Cosmo Color from Silicon Graphics. One skilled in the art will recognize 
that other conventional or newly developed software processes may be used as well and the 
invention may be implemented using hardware or a combination of hardware and software. 

1 5 One skilled in the art will recognize that the invention can apply to other browser technology, 
such as local CD browsers and other non-Internet browsers. 

Referring to FIG. 1, a flowchart 10 of an algorithm for implementing the present 
invention is illustrated. The present invention is typically enabled when browser begins to 
reassemble the web page onscreen, following the hidden HTML codes in the main document 

20 to determine where to place text, graphics or videos onscreen. In particular, the present 

algorithm is implemented when browser begins to assemble the image part of the web page to 
be displayed. One skilled in the art, however, will recognize that implementation of the 
present invention can be initiated at anytime an image is present. The present invention 
initially determines whether the image has been color enabled (step 12) and whether the 

25 image has been color corrected (step 14). The present invention then determines the whether 
the system is acting in accordance with steps 12 and 14 above to provide color accuracy (step 
16). Upon determining whether the image is color enabled (step 12) and corrected (step 14), 
notification is provided about the integrity of color imagery currently being viewed by the 
client at a specific web site. In particular, when the image is color enabled and corrected, 

30 notification is provided to the client that the color of the image is accurate (step 18). If the 
image is not either color enabled or corrected, notification is provided to the client that the 
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color of the image may not be accurate (step 20). The invention then returns to a standby 
mode until another web page with images is detected. 

As noted above, in step 12, the present invention determines whether the displayed 
image has been color enabled by detecting whether there is color correction information (i.e. 

5 color specific files for the device characteristics of the reference image as represented on the 
reference device) associated with the displayed image. For example, to detect whether an 
image is color enabled, the present invention detects whether the following color correction 
information (i.e. color specific files or registry entries) is associated with the image: (1) user 
specific Hypertext Markup Language (HTML) tags within the web page that designate the 

1 0 color properties of the source image, (2) standard ICC profiles which are embedded within the 
image file itself and (3) pointers to user specific (i.e. HTML) or standard (i.e. ICC profiles) 
color files associated with the image file. One skilled in the art will recognize that the present 
invention is not limited to detecting specific color correction information, nor is it limited just 
to fully composed web pages as opposed to individual images or portions of images. 

15 In operation, to determine whether an image is color enabled via HTML color 

corrected information, the preferred embodiment of the present invention detects whether user 
selected predetermined HTML tags are present in the web page. HTML, a markup language 
used for documents on the web, uses standard tags to mark elements, such as text and 
graphics, in a document to indicate how web browsers should display these elements to the 

20 user and should respond to user actions. The present embodiment detects whether the web 
page includes predetermined HTML tags. For example, in the preferred embodiment, when a 
web page with an image is color enabled, the HTML tags direct a browser to display a 
predetermined text as a headline of a certain size, such as the title 'True Internet Color": 

<html> Marks the beginning and end of an HTML-coded file 
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</head> Contains descriptive information, like the title and author, not displayed 
onscreen. It also holds formatting information, such as style sheets. 

<title> Shop-o-rama True Internet Color(r)</title> Sets the web page's title, 

displayed in the blue bar atop the screen 

</head> Contains descriptive information, like the title and author, not displayed 
onscreen. It also holds formatting information, such as style sheets. 

<html> Marks the beginning and end of an HTML-coded file 

FIG. 2 is a depiction of a screen view of a web page 22 having a title "True Internet 
Color" thus enabling the present invention to recognize that the page is color enabled. Thus 
when a web page includes the title 'True Internet Color" the image is considered to be color 
enabled. One skilled in the art will recognize that the present invention is not limited to 
recognition of HTML tags directed at the title "True Internet Color," but rather may be any 
predetermined HTML tag, or web image tag, configuration. 

To determine whether an image is color enabled via ICC color correction information, 
the present invention detects whether ICC profiles (for the device characteristics of the 
reference image as represented on the reference device) are embedded within the image file 
based upon an ICC profile format specification. In particular, the present invention detects 
data stored in ICC profiles, which are described in the ICC profile specification. ICC profiles 
are device profiles that can be used in pairs to translate color data created on one device into a 
native color space of another device. More specifically, an ICC profile is provided for each 
device and is used by the present invention to transform color image data from a device- 
dependent color space to the profile connection space, and to transform color image data from 
the profile connection space to another device-dependent color space. These ICC profiles for 
the device characteristics of the reference image as represented on the reference device may 
be embedded in the image file or stored in a memory in a connected personal computer. For 
example, the ICC profiles could be stored in a memory, accessible by a CPU, and associated 
with the image instead of embedded. Additionally, it should be noted that ICC profile can be 
assessed by the client from a variety of other sources such as network interface or from other 
external devices via a modem interface. 

To determine whether an image is color enabled— even without an embedded or 
associated color profile— the present invention detects whether the image is in a known color 
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space, such as SRGB. SRGB is a well-defined color space, includes various versions such as 
SRGB 64, and is further defined at http://www.srgb.com. One skilled in the art will recognize 
that implementation of the present invention may be used with any kinds of images, including 
those subject to compression techniques, such as GIF, PNG or JPEG formatted images. 

Referring to step 14, the present invention interrogates the client system to determine 
if that system is characterized and calibrated to the same state, or to a different but known 
state. In other words, the present invention detects the presence of a transfer function in the 
client system, i.e. in the hardware or software (or the combination of hardware/software and 
human perception). In particular, the present invention checks file entries and registries, or 
pointers to such entries and registries, to determine whether characterization parameters are 
present. A flag, initialized to a set value, signals whether the client system has been 
characterized. For example, in a typical embodiment, a binary flag initialized to a zero value 
is set to a non-zero value when the present invention detects the client system is characterized. 
In accordance with the present invention, a client may use any type of conventional or newly 
developed color calibration system including, for example, the interactive color calibration 
method disclosed in U.S. Patent No. 5,638,117. 

Referring to step 16, the present invention then determines the whether the system is 
acting in accordance with steps 12 and 14 above to provide color accuracy. In particular, 
once the present invention confirms that the presence of color correction information in the 
displayed image (step 12) and the image has been adjusted, as needed, to display properly on 
the calibrated or characterized client system (step 14) (i.e. color accuracy is being provided 
for in step 16), a notification is displayed to the user (step 18). When the software process 
determines that color accurate display is occurring on all or part of the image, then an 
appropriate notification is made to inform the user that color correction has occurred where 
marked. One skilled in the art will recognize that the particular type of notification is not 
critical to the invention. The notification may be visual or non-visual notification (e.g. audio). 
For example, the visual notification may be an icon that provides users with a visible 
indication about the integrity of color imagery currently being viewed by the client at a 
specific web site. It does this by briefly flashing the cursor for a fraction of a second to 
indicate if whether or not the page is being viewed utilizing color correction. This icon can be 
implemented in addition, or instead, in the OS, in a web-enabled application, or in a browser 
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(when implemented on as a client-side application); or it can be implemented as an image, 
tag, program, or watermark embedded within a web page by the web server or by any of the 
links between server and client within the network infrastructure. 

For example, when a user requests a Web page from a web site enabled by the present 

5 invention, the HTML is sent to the client directly from the web site's main servers. A 

specially attached URL link calls up color-corrected images from the hosted server, and the 
client's browsers integrate the two pieces automatically. Thus, in accordance with the present 
invention, the notification not only provides notification feedback to the user, but also 
reinforces a message of data fidelity to the end-user in determining whether the color data is 

10 accurate or not. The present invention has applicability for any client viewing or display 
application where color accuracy is important to the communication of information. 
Examples include, but are not limited to, viewing artwork, fashion, cosmetic, logo or brand 
colors, paint, photography and other color-sensitive information over a medium such as the 
Internet where content viewer and content creator are disconnected by physical space and/or 

15 time. Although, for illustrative purposes, the present invention is described and illustrated 
utilizing web pages hosted on a server and displayed with color correction on a client, the 
invention is not limited to such a configuration. Rather, the present invention would apply 
equally well to images displayed on any imaging peripheral including transmissive, reflective, 
and other source and/or client imaging technologies. Moreover, the present invention would 

20 also apply to images not viewed by the Internet, such as images within computer applications, 
TV, broadcast, or other client output media of any kind, including printed output. The present 
method would apply to both digital images and analog images including both real and 
synthetic images authored for, and/or viewed on, a client system. 

The present invention may be implemented as a client-based notification system 30 as 
25 shown in FIG. 3 or server-based notification system 50 as shown in FIG. 4. With respect to a 
client-based notification system, the present invention may be installed on a client system 
such as client 38, peripheral, and/or other output technology that has various states of visual 
display to notify the user about the state of color correction for digital images output or 
displayed. Referring to FIG. 3, a functional block diagram of a client-based notification 
30 system 30 for providing critical end user feedback as to the color correction status of imagery 
on a client display is illustrated. Client-based notification system 30 is shown with hosted 
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color server 32, mirrored server 34, non-mirrored server 36 and clients 38, 40, 42, 44 and 46 
which represent the various types of clients, that is, clients such as 38 and 40 which include 
the client based notification techniques of the present invention (indicated by the term 
"icon"), clients 38, 40, 42 and 44 which are characterized for color, clients 42 and 44 which 
have a known transfer function and client 46 which is not characterized, has no known color 
transfer function and does not include a notification system according to the present 
invention. 

Icon 66 depicted in Fig. 5(b), provided by client 38 is preferably initiated to a non- 
corrected state. When client 38 sends a request to mirrored server 34, which mirrors hosted 
color server 32, a color corrected requested image is sent from hosted color server 32 to client 
38 including a color notification tag, such as a specific HTML title bar flag. The Web page 
HTML from server 34 includes a color notification tag within its HTML tags to indicate in the 
title bar that the images to be sent by server 32 have been enabled for color correction. For 
example, as shown in FIG. 2, the title bar of the web page may include a notification in its 
title bar, such as "True Internet Color", in addition to other terms such as the name of a 
related company, to indicate color correction. As noted above, one skilled in the art will 
recognize that the present invention is not limited to the detection of predetermined HTML 
title tags, rather, any device capable of detection may be used as the color notification tag. 
Upon arrival at the client 38, the present invention detects the color notification tag by 
evaluating the HTML tags sent from server 34 to determine whether the image delivered from 
server 32 has been color correction enabled by detecting the True Internet Color tag in the 
title. It also checks whether client 38 has been color characterized or calibrated to a known 
state. If both conditions are true, an icon such as icon 66 depicted in FIG. 5(b) is changed to a 
corrected state as depicted by icon 64 in FIG. 5(a). In contrast, when client 38 sends a 
request to a site providing non color corrected pages, such as non-mirrored server 36, which is 
does not include the special HTML tags, such as 'True Internet Color" to indicate color 
correction, then icon 66 remains unchanged from its non-corrected default state. 

Still referring to FIG. 3, local client 40 is characterized but includes no applet 
incorporating the present invention for notification as indicated by the phrase "no-icon". 
Local client 40 is in direct communication with mirrored server 34 and hosted color server 32. 
Local client 40 provides no notification icon. When local client 40 sends a request to 
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mirrored server 34, the requested image is color corrected and sent back by hosted color 
server 32, with no notification icon on client 40. When local client 40 communicates with 
non-mirrored server 36, the requested image is not color corrected, and there is no notification 
icon to this effect. 

5 Client 42 is characterized and includes a known (characterized or calibrated) transfer 

function but no applet incorporating the present invention for notification. Client 42 is in 
direct communication with mirrored server 34 and non-mirrored server 36 and in direct 
communication with hosted color server 32 via redirection requests from mirrored server 34. 
Client 42 provides no notification icon. When client 42 sends a request to mirrored server 34, 

10 the requested image is corrected. However, no notification indicating color correction is sent 
back to client 42. When client 42 sends a request to non-mirrored server 36, the requested 
image is not color corrected and no notification of color correction is sent back to client 42. In 
such case, the title bar of the web page would not indicate a color corrected image. 

Client 44 is characterized and includes a known (characterized or calibrated) transfer 
15 function and includes an applet incorporating the present invention for notification. Client 44 
is in direct communication with mirrored server 34 and non-mirrored server 36 and in direct 
communication with hosted color server 32 via redirection requests from mirrored server 34. 
Client 44 provides a notification icon. When client 44 sends a request to mirrored server 34, 
the requested image sent by hosted color server 32 is color corrected. In such case, the title 
20 bar of the web page would indicate a color corrected image. Notification indicating color 

correction is sent back to client 44 indicating a color corrected image being displayed. When 
client 44 sends a request to non-mirrored server 36, the requested image is not corrected and 
no notification of color correction is sent back to client 44. In such case, the title bar of the 
web page would not indicate a color corrected image. 

25 Client 46 is neither characterized nor includes an application incorporating the present 

invention for notification. Client interacts with non-mirrored server 36 only and provides no 
notification icon. When client 46 sends a request to non-mirrored server 36, which is not in 
mirror communication with hosted color server 32, the requested image sent by non-mirrored 
server 36 is not color corrected and no notification is provided to the client 46. In such case, 

30 the title bar of the web page would not indicate a color corrected image. 
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Referring now to FIG. 4, a functional block diagram of a server-based notification 
system 50 for providing critical end user feedback as to the color correction status of imagery 
on a client display is illustrated. With respect to a server-based notification system, the 
present invention may be installed on a web site server to notify the user about the state of 
color correction for digital images output or displayed. In particular, the icon of the present 
invention can be implemented in an image, tag, program, or watermark embedded within a 
web page by the web server or any of the links between server and client within the network 
infrastructure. Server-based notification system 50 is shown with hosted color server 52, 
mirrored server 54, non-mirrored server 56 and clients 58, 60, 62 and 64. The icon of the 
present invention is installed in hosted color server 52 and mirrored server 54 and not in non- 
mirrored server 56. 

When client 58 sends a request to hosted 52, client 58 may communicate through 
some means that it is a client that is of a specific, known calibration. This notification may be 
included in the HTML stream sent by the browser, or via any other method. In that case, if a 
color corrected image is sent from hosted color server 52 (or from mirrored server 54) to 
client 58, then an icon is also sent by mirrored server 54 or by hosted color server 52 to 
indicate that the image has been corrected. In contrast, when client 58 sends a request to non- 
mirrored server 56, which is not in communication with hosted color server 52, non-mirrored 
server 56 does not include an icon (or sends an icon indicating that no color correction has 
occurred). 

In accordance with an alternative embodiment of the invention, client 60 is 
characterized and includes an applet incorporating the present invention for providing 
notification. Local client 60 is in direct communication with mirrored server 54 or hosted 
color server 52, which also includes the notification icon. When client 60 sends a request to 
mirrored server 54 or hosted color server 52 as described above, the requested image is color 
corrected and sent back by web site server along with a notification icon indicating a 
corrected state. Mirrored server 54 also sends the HTML tags indicating color correction and 
the icon on client is changed to indicate the corrected state. Logic is implemented to arbitrate 
between the state of the two icons (server-based and client-based). For example, in one 
embodiment either the server or client based notification icon may take precedence while in 
another embodiment a third icon, similar to the icons shown in FIGS. 5(a) and (b), may be 
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used to indicate the presence of a different level of color correction based on the presence of 
both server and client based notifications. 

Client 62 is neither characterized nor includes an application incorporating the present 
invention for notification. When client 62 sends a request to server 54, then either server 52 

5 would use HTML tags to add some watermark or other image to the web page to indicate 
color accuracy; or server 52 would request web server 54 to send an image which already has 
an icon superimposed on the image sent by server 54. When client 62 sends a request to non- 
mirrored server 56, the requested image sent by non-mirrored server 56 is not color corrected 
and no notification is provided to client 62. In such case, the title bar of the web page would 

10 not indicate a color corrected image, and no icon would be sent by non-mirrored server 56. 

In accordance with an alternative embodiment of the present invention, depending 
upon the relationship between the mirrored server 54 and hosted color server 52, hosted color 
server 52 may require mirrored server 54 to identify images not color corrected. In such case, 
a server based icon can be sent to a client to indicate images which are not color corrected. 

15 In accordance with another alternative embodiment of the present invention, 

multilevel icon certifications may be provided. In particular, multilevel icon certifications can 
be utilized to distinguish between icon certifications between various entities providing for 
color correction. For example, when hosted color server 52 provides color correction, an icon 
identifying not only color correction, but correction specifically provided by a particular 

20 hosted color server, is sent to the client. On the other hand, if color correction is provided by 
another entity, an icon identifying color correction, without identification of a specific entity 
providing for correction, is sent to the client. 

Having now described the invention in accordance with the requirements of the patent 
statutes, those skilled in the art will understand how to make changes and modifications in the 
25 present invention to meet their specific requirements or conditions. Such changes and 

modifications may be made without departing from the scope and spirit of the invention as set 
forth in the following changes. 
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WHAT IS CLAIMED IS: 

1. A method for providing feedback to a user as to color correction status of an image 
on a local display, comprising the steps of: 

determining presence of color correction information in said image; 
5 determining state of calibration of said user's system; 

notifying said user of color correction status in accordance with said steps of 
determining the presence of color correction information in said image and determining state 
of calibration of said user's system. 

10 2. The method claimed in claim 1 , wherein said method is implemented in a software 
process loaded into an Internet browser. 

3. The method claimed in claim 1 , wherein said method is implemented in a software 
process loaded into a content browsing application.. 

4. The method claim in claim 1, wherein said method is implemented in a software 
1 5 process loaded into server technology that is viewed by a remote client. 

5. The method claimed in claim 1, wherein said method is implemented in a software 
process loaded into server technology that is viewed by a local client. 

6. The method in claim 1, wherein said method is implemented both as a software 
process loaded into a content browsing application and server technology approximately 

20 simultaneously, together with an arbitration mechanism to determine the proper notification 
of status. 

7. The method claimed in claim 1, wherein said color correction information comprises 
HTML color information. 

25 8. The method claimed in claim 1, wherein said information on the state of calibration of 
said end users' system comprises HTML color information. 
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9. The method claimed in claim 1 , wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting whether HTML tags that designate color properties are present in a web page 
associated with said image. 

5 

10. The method claimed in claim 1 , wherein said step of determining presence of color 
correction information in said image, further comprises the step of detecting whether HTML 
tags that designate color properties are sent via one server, referencing said image sent by a 
different server. 

10 

11. The method in claimed in claim 1, wherein the information about the state of 
calibration of said user's system is determined by said server by detecting HTML tags sent by 
said server. 

15 12. The method claimed in claim 1, wherein said color correction information comprises 
ICC profile color correction information. 

13. The method claimed in claim 1, wherein the information about the state of calibration 
of said user's system comprises ICC-format profile information. 

20 

14. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting whether ICC profiles are embedded within the image, or associated with the 
file, based upon ICC profile format specifications. 

25 

15. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting GIF-formatted images based upon GIF profile format specifications. 

30 16. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting PNG-formatted images based upon PNG profile format specifications. 
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17. The method claimed in claim 1 , wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting JPEG-formatted images based upon JPG profile format specifications. 

18. The method claimed in claim 1 , wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting images in a known color space. 

19. The method claimed in claim 1, wherein said step of determining presence of color 
correction information in said image, further comprises the step of: 

detecting images in a predefined color space. 

20. The method claimed in claim 1 , wherein said step of notifying said user of color 
correction status in accordance with said steps of determining the presence of color correction 
information in said image and determining state of calibration of said user's system, further 

comprises the step of: 

providing a visual notification regarding the status of color correction status of said 

image. 

21 . The method claimed in claim 20, wherein said visual notification is an icon. 

22. The method claimed in claim 1 , wherein said step of notifying said user of color 
correction status in accordance with said steps of determining the presence of color correction 
information in said image and determining state of calibration of said user's system, further 

comprises the step of: 

providing auditory notification regarding the status of color correction status of said 

image. 



23. The method claimed in claim 1, wherein said step of notifying said user of color 
correction status in accordance with said steps of determining the presence of color correction 
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information in said image and determining state of calibration of said user's system, further 

comprises the step of: 

providing sensory notification regarding color correction status of said image. 

5 24. The method claim claimed in claim 23, wherein said step of providing sensory 

notification regarding the status of color correction status of said image, further comprises the 
step of: 

providing touch-based notification regarding color correction status of said image. 

10 25. The method claim claimed in claim 23, wherein said step of providing sensory 

notification regarding the status of color correction status of said image, further comprises the 
step of: 

providing taste-based notification regarding color correction status of said image. 

15 26. The method claim claimed in claim 23, wherein said step of providing sensory 

notification regarding the status of color correction status of said image, further comprises the 
step of: 

providing smell-based notification regarding color correction status of said image. 

20 27. A client based icon applet for use in indicating to an end user a state of color 
correction of digital images being viewed, comprising: 

an icon having a first state indicating that images being viewed are color corrected as 
viewed and a second state indicating that images being viewed are not color corrected as 
viewed; and 

25 logic for determining if the image being viewed includes a color notification tag and a 

display device associated with the use is calibrated for corrected color display for inserting a 
selected state of the icon to be inserted in the digital image to be viewed. 

28. The client based icon applet claimed in claim 27, wherein said icon is initiated to the 
30 second state indicating that images being viewed are not color corrected as being viewed as a 
default state. 
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29. The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for evaluating HTML tags sent by a server to determine whether said image has 
been color corrected. 

30. The client based icon applet claimed in claim 29, wherein said logic for evaluating 
HTML tags sent by a server to determine whether said image has been color corrected further 
comprises: 

logic for evaluating predetermined HTML title tags sent by a server to determine 
whether said image has been color corrected. 

31. The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for detecting the presence of a transfer function in a client system. 

32. The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for detecting the presence of characterization parameters. 

33. The client based icon applet claimed in claim 27, further comprising: 

a flag having a first state indicating that the display devices associated with the use is 
calibrated for corrected color display and a second state indicating that the display devices 
associated with the use is not calibrated for corrected color display; and 

logic for determining if the display device associated with the use is calibrated for 
corrected color display for determining a selected state of the flag. 
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34. The client based icon applet claimed in claim 27, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

5 logic for inserting the icon having the first state indicating that images being viewed 

are color corrected and the display device associated with the use is calibrated for corrected 
color display. 

35. The client based icon applet claimed in claim 27, wherein said logic for determining if 
10 the image being viewed includes a color notification tag and a display device associated with 

the use is calibrated for corrected color display for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for inserting the icon having the second state indicating that images being 
viewed are not color corrected or the display device associated with the use is not calibrated 
15 for corrected color display. 

36. The client based icon applet claimed in claim 28, wherein said logic for determining if 
the image being viewed includes a color notification tag and a display device associated with 
the use is calibrated for corrected color display for inserting a selected state of the icon to be 

20 inserted in the digital image to be viewed further comprises: 

logic for leaving the icon in the default second state indicating that images being 
viewed are not color corrected or the display device associated with the use is not calibrated 
for corrected color display. 

25 37. The client based icon applet claimed in claim 27, wherein said icon also identifies 
color correction by a particular server. 

38. A server based icon applet for use in indicating to an end user a state of color 
correction of digital images being viewed, comprising: 
30 an icon having a first state indicating that images being viewed are color corrected as 

viewed and a second state indicating that images being viewed are not color corrected as 
viewed; and 
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logic for determining if a client has a specific, known calibration for inserting a 
selected state of the icon to be inserted in the digital image to be viewed. 

39. The server based icon applet claimed in claim 38, wherein said logic for determining if 
5 a client has a specific, known calibration for inserting a selected state of the icon to be 
inserted in the digital image to be viewed further comprises: 

logic for determining the presence of an HTML stream sent by a browser associated 
with said client. 

10 40. The server based icon applet claimed in claim 39, wherein said logic for determining 
the presence of an HTML stream sent by a browser associated with said client further 
comprises: 

logic for inserting the icon having the first state indicating that images being viewed 
are color corrected when a HTML stream is detected. 

15 

41. The server based icon applet claimed in claim 39, wherein said logic for determining 
the presence of an HTML stream sent by a browser associated with said client further 
comprises: 

logic for inserting the icon having the second state indicating that images being 
20 viewed are not color corrected when a HTML stream is not detected. 



WO 00/23944 PCT/US99/24577 



1/4 






12-^ 




NO, 


20 

\ I 




NON-COLOR 


CORRECTED 


NOTIFICATION 



IMAGE" 
COLOR 
ENABLED 



CLIENT 
CALIBRATED 



COLOR ENABLED 
AND CLIENT 
CALIBRATED 



COLOR CORRECTED 
NOTIFICATION 



f 



10 




16 



18 



— 14 




^NO 






20 






NON-COLOR 


CORRECTED 


NOTIFICATION 



FIG. 1 



WO 00/23944 



PCT/US99/24577 




WO 00/23944 



PCT/US99/24577 



FIG. J 



3/4 




CLIENT 

- CHARACTERIZED 

- ICON 



CLIENT 

- CHARACTERIZED 

- NO ICON 



38 



40 



CLIENT 

- CHARACTERIZED 

- KNOWN TRANSFER FCN 

- NO ICON 



CLIENT 

- CHARACTERIZED 

- KNOWN TRANSFER FCN 

- ICON 



CLIENT 

- NOT CHARACTERIZED 

- NO ICON 



42 



44 



46 



FIG. 4 



52 



HOSTED 
COLOR 
SERVER 



54 -\ MIRRORED 
" SERVER 



56 



NON-MIRRORED 
SERVER 




CLIENT 

- CHARACTERIZED 



CLIENT 

- CHARACTERIZED 

- ICON 



58 



60 



CLIENT 

-NON- CHARACTERIZED 



62 



WO 00/23944 



PCT/US99/24577 





FIG. 5B 



INTERNATIONAL SEARCH REPORT 



Into torus' Appttaitioo No 

PCT/US 99/24577 



MATTER 



A. CLASSIRCATIONOFJBJiBJECT 

IPC 7 G06T5/00 



Aooordhg to tntamaflonai Patent qaastfteaflon (IPC) or to both national daaarflcaflon and IPC 



& FIELDS 8EARCHEO 



Mrtmum documents!^ eeair^ (< 

IPC 7 606T 



[ctaeeMcaflon avetem folowad by cteusafflcatJon aymbote) 



Docunerrta^aeeiohed other than n tn the flelde searched 



Bectrorso data IxiaeceneuJiad during the tTtemaflona) search (name of data base and, where practical sea** terms ueed) 



a DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 9 Cftattonof oVxurieitwtthhol^ 



Relevant to dafen No. 



P,A 



EP 0 878 303 A (PRESSTEK INC) 
18 November 1998 (1998-11-18) 
abstract 

column 3, line 40 -column 4, line 3 
column 14, line 1 - line 7 

WO 98 37690 A (SONY CORP ;KAT0 NAOYA (JP); 

NAKABAYASHI KIYOTAKA (JP)) 

27 August 1998 (1998-08-27) 

& EP 0 907 283 A (FUJI XEROX CO LTD) 

6 Nay 1998 (1998-05-06) 

page 4, line 33 -page 5, line 17 

page 5, line 54 -page 6, line 6 

page 33, line 45 -page 34, line 4 



1-41 



1-41 



LI 



Further doounerib ere fated In the connnuaflon of box C. 



ID 



Patent tamfly membem are leted ai annex. 



•Spec^categorteaofofteddooumenta: 

■A* docunentdetkihgtheg^r^a^o^ art which la not 

considered to be of particular relevance 
"E" eftrUerdocttnwtbUpublahedonoraftef the fc t tem afl o na J 

longdate 

V docurierfwt^ may throw dc^ ctatn(e)or 
wtich fe dted to establish the pubtteation date of another 
cftatlon or otriecepeoW reason (aa apeotfled) 

XT dooumei* referring to an o^ exhfcffionor 
other meana 

■P" doounerAr^Mahedprfortotto fJbgdatabut 
later than the priority date claimed 



T later document pubOehed after the fcrtemaflonal flhg date 
or priority date and not kiconflot wtth the appioatlon but 
cited to understand the prtxspte or theory underlying the 



"X" document of pailk^arrelevaiK^ the claimed tivenrJon 
cartwtbeoonskterednovd orcanriotbeconakier^ to 
kivotve an trwentrve ttep when the document la taken alone 

"Y* document of particular re4e*arx^ to twenfion 
cannot be coneWered to Involve an tiverrttve step when the 
documer<lacomb^wtthoneorrnorec<^ eijch docu- 
ments, auoh combination being obvious to a person akAed 
lithe art 

daxrrtentrneiTtw of ttieaamepetert 



Date of the actual oornptedon of the bitematk>nal search 



25 February 2000 



Date of mating of the International search report 



06/03/2000 



Name and mathg address of the ISA 

European Patent Office, PB. 5818 Patenflaan 2 

NL-2280HVRQswlJc 

Tel. (431 -70) 340-2044 Tx. 31 651 epo rJ, 

Fax (431-70) 340-3016 



Authorized ofBoer 



Gonzalez Ordonez, 0 



INTERNATIONAL SEARCH REPORT 


In* ioml Application No 


* 


PCT/US 99/24577 



cSow^TaHonoT^ 



RdeverttodatonNa. 



P,A 



EP 0 889 636 A (FUJI PHOTO FILM CO LTD) 
7 January 1999 (1999-01-07) 
abstract 

page 2, line 6 - line 10 
page 2, line 55 -page 3, line 1 
page 3, line 49 - line 53 
page 7, line 16 - line 21 

PATENT ABSTRACTS OF JAPAN 

vol. 1998, no. 10, 

31 August 1998 (1998-08-31) 

& JP 10 117290 A (FUJI XEROX CO LTD), 

6 May 1998 (1998-05-06) 

abstract 



1-41 



1-41 



INTERNATIONAL SEARCH REPORT 

y WotBMdion pttHrit family in*iulnfi- 


Ink ioradi 
PCT/US < 


IppficrtonNo 

99/24577 


Patent document 
cted In search report 


PiWcatlon 
date 


Patent famly 
member^) 


PiMcatlon 
date 



EP 0878303 A 18-11-1998 AU 6476898 A 19-11-1998 

CA 2236897 A 15-11-1998 
JP 11123808 A 11-05-1999 



WO 9837690 


A 


27-08-1998 


EP 
JP 


0907283 A 
11032228 A 


07-04-1999 
02-02-1999 


EP 0889636 


A 


07-01-1999 


AU 


7395498 A 


07-01-1999 






JP 


11073295 A 


16-03-1999 








JP 


11073382 A 


16-03-1999 



JP 10117290 A 06-05-1998 NONE 



orr«J«Mrt iimlm * fca rfw wwrt Lkt* 1 0021 



I 

V 



i) p 



THIS PAGE BLANK (uspto) 



